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Abstract. A plateau in a Motzkin path is a sequence of three steps: an up step, 
a horizontal step, then a down step. We find three different forms for the bivariate 
generating function for plateaus in Motzkin paths, then generalize to longer plateaus. 
We conclude by describing a further generalization: a continued fraction form from 
which one can easily derive new multivariate generating functions for various kinds of 
path statistics. Several examples of generating functions are given using this technique. 



A Motzkin path is a finite sequence of steps with the following properties: each step 
is "up" (labeled U), "horizontal" (labeled H), or "down" (labeled D); at any point in 
the sequence, the number of up steps is at least as big as the number of down steps; the 
total number of up steps in the sequence is equal to the total number of down steps. The 
number of steps in the sequence is referred to as the length of the path. Motzkin paths 
can be visualized as graphs in the plane beginning at (0, 0) and consisting of up steps in 
direction (1, 1), horizontal steps in direction (1,0), and down steps in direction (1, —1). In 
this visualization, the path ends at point (n, 0), where n is the length of the path, and 
never passes below the horizontal axis. We will use this visualization to refer to the points 
between steps as vertices. 

To begin, we define a plateau in a Motzkin path to be a subsequence of the path 
consisting of an up step immediately followed by a horizontal step immediately followed 
by a down step (such a subsequence is often abbreviated UHD). In this paper we establish 
several forms for generating functions that count plateaus for Motzkin paths. We then 
generalize those methods to longer plateaus and also use continued fractions to derive 
similar bi- and multivariate generating functions. 

The enumeration of plateaus in Motzkin paths has applications in the theory of RNA 
secondary structures [SJ [5] . Work by Prodinger and Wagner [1] examines plateaus in 
Motzkin paths with a different goal. 

1. Forms for generating functions 

In this section we state three theorems about forms for the generating function which 
counts plateaus for Motzkin paths. Let be the number of Motzkin paths of length n 
with p plateaus, and let 

oo If J 
n=0p=0 

so g is the bivariate generating function for this array. 
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Theorem 1. The function g has an integral/differential form given by 
(1) 9(X,V) = ! _2~3(f _ ff) (/o(«) + 1 J 2.ru!./\[ ! ' ir - l]tU 



wh 



ere 



. . . 1 - x + x 3 - - x + a; 3 ) 2 - 4a; 2 

AW = ^2 ■ 



2x 

Theorem 2. The function g has a differential form given by 

Theorem 3. The function g has an explicit form given by 

1 — x + x 3 — x 3 y — (1 — 3x + x 3 — x 3 y)(l + x + x 3 — x 3 y) 



(3) g{x,y) = 



2x 2 

2. Proof of Theorems HHBJ 



Our plateau-counting formulas depend on a recursion among the c v n . This can be 
obtained by the process of "sewing in" a plateau, as the first lemma reveals. After stating 
and proving the lemma, we'll turn to proving the theorems. 

Lemma 1. If we set = when p is negative or n is negative, then the satisfy 

(4) * = ^«CJ + 2 <-3 

for all n and for all p > 0. 

Proof of Lemma^ To get a path of length n with p plateaus, we can start with a path of 
length n — 3 with p — 1 plateaus and sew in a plateau by inserting a UHD subpath at any 
vertex. There are n — 3 + 1 vertices into which a plateau can be sewn in a path of length 
n — 3. Sewing in a plateau in this way always gives us a new plateau and a Motzkin path 
of length n. Sometimes, however, the sewing operation destroys an existing plateau in the 
path of length n — 3. If a plateau is sewn on a vertex that is adjacent to the horizontal 
step in an existing plateau (such a vertex will be said to be inside a plateau) , we destroy 
the plateau that was in the original path of length n — 3 in order to create one in the 
path of length n. In all other places, sewing in a plateau creates a new plateau without 
destroying a previous one. In summary, to get a path of length n with p plateaus, we can 
sew in a plateau at any of the n — 3 + 1 — 2(p — 1) vertices which are not inside a plateau 
in a path of length n — 3 with p — 1 plateaus, or we can sew in a plateau at any of the 2p 
vertices inside plateaus of a path of length n — 3 with p plateaus. By doing this, we can 
generate all of the paths of length n with p plateaus. In fact, we generate each path p 
times, according to our choice of which plateau is sewn in. Thus, we get the recursion 

v _ n-2-2(p-l) x 2p 



P p 

which simplifies to Q. □ 

As a note, to use the recursion, we'll need to be given the sequence {c° }. We'll see that 
the sequence {c"} obeys a Catalan- like recurrence relation given below in (J6|. 

To give a sense of what this array of numbers looks like, see the table of values of c£ 
for small n and p given in Table [l] That triangle is sequence Al 14583 in the OEIS [3]. 
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Table 1 . for small values of n and p. 



2.1. Proof of Theorem [TJ generating functions for each p. To prove Theorem [Tl 
we first find the generating function for the sequence {c°}^L j the first column of Table Tl] 
Let fo(x) denote that generating function. We first show the following. 

Lemma 2. The function fo is given by 

1-x 



(5) 



fo(x) 



+ X 3 - -X + X 3 ) 2 



4x 2 



Furthermore, the sequence {c"} satisfies 
(6) C°n = cl-l + C 



2x 2 



n-2 

C k C n-k-2- 

k=2 



Proof of Lemma^ The terms of the sequence {c° } are the number of Motzkin paths of 
various lengths which have no plateaus. Each such path falls into one of three categories. 
Category 0: the empty path. This contributes 1 to fo(x). 

Category 1: the path starts with a horizontal step. In this case, the horizontal step is 
followed by a Motzkin path of length n — 1 with no plateaus. The generating function for 
such paths is xfo(x). 

Category 2: the path starts with an up step. In this case, the path can be decomposed 
into 

(1) an up step, 

(2) a plateau-free Motzkin path that is not a single horizontal step, 

(3) a down step, then 

(4) any plateau-free Motzkin path. 

That decomposition tells us that the generating function for paths in category 2 is 
x(fo(x) ~ x)xf {x). 
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Every plateau-free Motzkin path falls into exactly one of the above categories, so 
fo(x) = 1 + xf Q (x) + x 2 f Q (x)(f (x) - x), 
which after an application of the quadratic formula yields 

, 1 - x + x 3 ± J (I - x + x 3 ) 2 - Ax 2 

m = & ■ 

The limit of fo(x) as x goes to zero is 1 (the empty path has no plateau), so we may take 
limits of both possibilities for fo(x) to see that only the subtraction term in the numerator 
makes sense, which gives 

Similar reasoning with the above categories and decomposition yields the recurrence 
relation for c° in ([6|. □ 

Remark. Note that the function in ^ is the generating function for OEIS sequence 
A114584 0. 

Proof of Theorem^ Knowing fo(x) and the recurrence relation from Lemma [TJ we can 
calculate the generating functions f p (x) — ^ n cji". For p > 0, one can multiply both 
sides of Q by x n and sum over n > to get 

n- 2p p _ 1 

' n~3 J 



fp (x) = e <* n = e v^-3* n + 2 e <- 

n=0 n=0 ^ n=0 

1 oo 

" E n <-l xn - 2 ^/p-iW + 2x 3 f p (x). 

The remaining sum above equals 



P n =o 



--J- [x 3 f P -i(x)] , 
p ax 1 J 

so one solves to find a recurrence relation for f p for p > 1: 

(7) /,(*) = (~ [x S U-i{x)) - 2x 3 f p ^)) , 

which can also be written 

T 2p+1 J 

We can use the recurrence for the generating functions f p {x) to derive the inte- 
gral/differential form for g(x,y) in ([T]). Start with Q, multiply both sides by y p and sum 
over all p > 1. This yields 

g(x,y) - f (x) = r - 1 ^3 £ ff^A'- 1 ^) ~ 2 ^/p-i(a;)) V P ■ 

A little rearrangement and simplification leads to 

g(x,y) = fo(x) + ^^/p-iWf' " Zx 3 g{x,y)^ , 
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and since 



-'—J p Ox y Ox 1 



we can solve for g to get our first expression for g(x,y) to get |T]). □ 

2.2. Proof of Theorem [2} summing array diagonals. In Theorem [l] we found a 
functional equation for g by finding generating functions for the columns of Table [l] 
For Theorem [2j we find a form for g by looking at the diagonals of that table. Let 
hk{z) = YZ=o d ™z m , where d m = cf m+k . For instance, h {z) = E^oC 2 " 1 = 
J2m=o I- 2 ™ = 1/(1 — since there is just one path of length 3m with m plateaus. Using 
the recursion from Lemma [IJ we get 

m _ m + m-1 , 9 TO 

°3m+fe — L 3m+/c-3 ' ZL 3m+/c-3' 

Substituting this into the generating function /i^, we get 

771 + fc 



X! rf m 2™ - c fe + X! ( m C 3(m-l) + fe + 2c 3m i A :s 1 



m— m— 1 

oo oo , oo 

- c k ' C 3(m-l)+fc Z + TO C 3(m-l)+fc Z + Z C 3m+(fc-3) Z 

m— 1 m— 1 rn — 1 

which reduces to 

h k (z) = zh k (z) + k f h k (t)dt + 2h k - 3 (z)-2c° k _ 3 + c° k . 
Jo 

Upon differentiation, we get the differential difference equation 
(8) h' k {z) = zh' k (z) + h k {z) + kh k (z) + 2h' k _ 3 (z) 

Returning to g, we can use ^ to derive first observe that 

k>0 

so that 

-xg (x, —^j = ^~^(fc + l)h k (z)x k and 



dx 



d 

9 



dz 



fe>0 



Since ^ can be rearranged into 

(fc + l)h k (z) = (I - z)h' k (z) - 2/4.3(2), 

if one multiplies both sides of that equation by x k and sums over all fc, we obtain ^ and 
complete the proof of Theorem [2j □ 
Remark. Much more can be said about the functions h k from the proof above. For 
instance, one may solve the differential equation ^ using standard techniques to obtain, 
for fc > 3, 

(9) h k (z) = {l _\ )k+l (c° k + 2 J\l - t) k h' k _ 3 (t) dt 
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We just need three initial conditions: when k = 0, we already know that ho(z) = 1/(1 — z). 
If k = 1, the recurrence yields the sequence of positive natural numbers, whose generating 
function is 1/(1 — z) 2 , and if k = 2, the recurrence relation produces the sequence 
2, 6, 12, 20, 30, 42, . . . , whose generating function is simply the derivative of the previous: 
2/(1 — z) 3 . With these three initial generating functions and the recurrence relation 
any hu(z) can be found. Note that if one defines h k {z) = for negative k, the recurrence 
(9) holds for all nonnegative k. 

Furthermore, for k = 0, 1, and 2, hk is a rational function whose denominator is 
(1 — z) k+1 , and it is a simple matter to use induction to prove that the same is true for 
all k: if hk-3 is a rational function of the form p/(l — z) k ~ 2 , where p is a polynomial of 
degree d, then the integrand in ([9| is a polynomial of degree d + 1, so the second factor in 
that expression is a polynomial of degree d + 2, and we see that the numerator of h k has 
degree 2|_fc/3_|. Moreover, if N k denotes the numerator of h k , the numerators obey the 
differential difference equation 

N k (z)=c Q k + 2^ (l-t) ((l-i)^W*-3(t) + (*-2)JV fc _ 3 (t)) dt . 
2.3. Proof of Theorem [3j explicit form. As a third approach to finding the generating 



function for the array {c^}, we can take the categories of paths defined in subsection 2.1 
for plateau-free Motzkin paths and use them to work on all Motzkin paths. Each Motzkin 
path falls into one of three categories: the path is empty, it begins with a horizontal step, 
or it begins with an up step. If it begins with an up step, it is of the form "UPDQ" where 
P and Q are Motzkin paths. Since Q can be any Motzkin path, the generating function 
describing the possibilities for Q is simply g. For P, we can have any path, but if we use a 
path that is a single horizontal step, we will create an extra plateau which is unaccounted 
for in the generating function multiplication. To combat this, we can subtract x from g 
and add xy to count the plateau properly. Therefore, g{x,y) satisfies 

(10) g(x, y) = l + xg(x, y) + x(g(x, y) - x + xy)xg(x, y). 

We can again use the quadratic formula in that functional equation and take limits to 
find the explicit form given in ([3|. □ 



3. Generalization to longer plateaus 

We can generalize the approaches in the three theorems above to longer plateaus. 
Define a plateau of length r to be a subsequence of a Motzkin path consisting of an up 
step, immediately followed by r consecutive horizontal steps, then a down step (we will 
abbreviate such a subsequence as "ULTD"). Using this definition, the previous calculations 
have been for plateaus of length 1. Since the groundwork has been laid, in this section we 
quickly state and prove results similar to the previously stated lemmas and theorems. We 
set r c^ to be the number of Motzkin paths of length n with p plateaus of length r 

Lemma 3. With r c v n as above, we have 

(11) rCl = B ~ (r B +1)P rCU + (r + 
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Proof. We observe that there are r + 1 vertices inside each plateau for which sewing in a 
plateau destroys the existing plateau upon creating another. Also, sewing in a plateau of 
length r increases the length of the path by r + 2. Therefore, we get the recursion 



r& - 



rc-(r + l)-(r + l)(p-l) x (r + l)p p 



r ^n- r^„_( r+2 ) ^ r^ n _( r+2 )) 



which simplifies to (111. □ 

We now quickly address each of the three approaches we used earlier for finding forms 
for the generating function r g{x,y) = Yl™=o T, P =o r c^x n y p . 

Theorem 4. The function r g satisfies the integral/ differential form 
(12) MXty ) = T J^0^ ( rMx ) 



d 



1 - (r + l)x r + 2 dx 

where 



x r+2 / r g(x,t)dt\, 



. . -x + x 2+r + 1 - J(x - x 2+r ~ l) 2 - 4.x 2 
r/o(x) = — 2 . 

Proof. We find a relationship for the generating functions r f p (x) = YlnLa r<%x n for each 
p, as we did in Lemma [2] We use the same categorization as discussed in the proof of that 
lemma, simply noting that now the second category consists of Motzkin paths that have 
an up step, then a Motzkin path with no plateaus of length r which is not a sequence of r 
horizontal steps, then a down step, then any Motzkin path with no plateaus of length r. 
We use this to obtain 

rfo(x) = 1 + X r f (x) + X 2 r f Q (x)( r fo(x) - X T ), 

where r fo(x) is the generating function for number of Motzkin paths of length n with no 
plateaus of length r. Solving the quadratic equation above yields an explicit form 

-x + x 2+r + 1 - ^/(x - x 2 + r - l) 2 - 4x 2 



(13) r/»W=E* n = 



71=0 



2a; 2 



The recursion for r c^ analogous to ^ in Lemma [2] is 

n-2 

r o _ o , v-* 



n-2 

„0 „0 _ 

-fc-2 r^n—r—2' 

k=Q 

We then continue as in the proof of Theorem [I] by multiplying both sides of ( 11 ) by x Tl 
and summing over n > to get 



rJp\X) = rC n X = - rC n _( r+2 ^X + (T + 1) } j r (^ l _( r+2 'l X ' 

71=0 71=0 P 71 = 

This can be manipulated using the same techniques as earlier to get the integral/differential 
form for r g in ( 14 1. □ 

Next, we can use the technique of summing array diagonals to get another form for r g. 
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Theorem 5. The function r g satisfies 

(14) ^9 (x, ^) = (1 - , - (r + Dx r+2 )§- z r 9 (*, • 

Proof. Define r hk{z) to be X)m=o rd m z m , where r d m = c™ +2 ^ m+fe . Using the recursion in 
Lemma |3| we get 

TTt I /c ^ / 1 \ 771 

r c (r+2)m+k = ~ »' C (r+2)m+/c- (r+2) + V + l)r c ( r +2)m+/s-()-+2) > 

which upon substitution into the definition of r h k , becomes 

r hk(z) = r c" + ^ ( m rC "r+2)(m-l) + fc + ( r + 1 )rC"r+2)m+k-(r+2) J Z ™ ■ 

Upon differentiation we get 

(15) rK(z) = z r h' k (z) + r h k (z) + k r h k (z) + (r + l) r h f k _( r+2 )(z), 



a differential difference equation similar to ([8j). This gives rise to (14), which is similar 
to ^ from Theorem [2] □ 

Finally, following the approach of the proof of Theorem [3j we show the following. 

Theorem 6. The function r g has explicit form 

. . l-x + x r+2 - x r+2 y - J(l-x + x r + 2 - x r + 2 y) 2 - Ax 2 

(16) r g{x,y) = . 

Proof. We understand that either a Motzkin path is empty, it begins with a horizontal 
step, or it begins with an up step. If it begins with an up step, it is of the form "UPDQ" 
where P and Q are Motzkin paths. Since Q can be any Motzkin path, the generating 
function for that part of the decomposition is r g. For P, we can have any path, but if 
we use a path that is a sequence of r horizontal steps we will create an extra plateau 
which is unaccounted for in the generating function multiplication. To combat this, we 
can subtract x r from g(x,y) and add x r y. Therefore, r g(x,y) satisfies 

(17) r g(x, y) = 1 + x r g(x, y) + x 2 r g{x, y)( r g(x, y) - x T + x r y). 



We use the quadratic formula in (17) to solve for r g explicitly to get ([16]). □ 

Remark. Observe that if r — 0, then the "plateaus" are just UD subpaths — that is, 
they are peaks, and when r = the generating function in Theorem [3] does correctly count 
Motzkin paths in which peaks have weight y; see OEIS sequence A097860 |3]- 

4. Further generalizations and continued fraction expansions 



The functional equation (17) leads us to a continued fraction form that generalizes the 
above generalization. Instead of choosing a specific plateau length, let us rewrite (17) as: 

(18) G(x, y) = l + xG(x, y) + x(G(x, y) + C)xG{x, y); 

here C simply stands for whatever correction we need to make for plateaus. Rearrange 
that functional equation and we have: 

G{x ' v)= l-x- X >C-a*G{x,vy 
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Inductively replacing G with the right-hand side of that equation yields the continued 
fraction expansion 

(19) G(x, y) = 1 2 , 

X 

1 X X^C 2 

1 - x - x 2 C ^~ 



l-x-x 2 C 



which we will write more compactly as 
G(x,y) ' 



\-x-x 2 C \l-x-x 2 C \l-x-x 2 C 
We can use this discussion to get continued fraction expansions for g and r g from earlier. 

Theorem 7. The function g of Theorems has a continued fraction expansion given by 

11 x 2 I 

(20) g(x,y) 



| 1 — x — x (xy — x) | 1 — x — x (xy — x) 

Proof. In our original problem, we needed to give weight xy to the horizontal step in a 
UHD subpath, not x, so in the above continued fraction, we simply set C — xy — x in 
(T9j). □ 

Theorem 8. The function r g of Theorems^^has a continued fraction expansion given 
by 

(21) r g(x,y) ' 1 



| 1 — x — x (x r y — x r ) | 1 — x — x (x r y — x r ) 



Proof. Set C = x r y - x r in ([19} . □ 

This form of the generating function has two advantages: first, we can specialize C to 
represent whatever plateau (or other features of the path) that we want, and second, we 
now have "infinitely many Cs" . The C appearing at the fcth level of ( 19 ) corresponds to 
corrections made at height k in a path (see Flajolet [U Theorem 1]), so we can generalize 
that continued fraction expansion to 

(22) G(xv)- 1 1 ^ 1 X " 1 

K ' 1 ,V) ~ | \-x-x 2 C x \l-x~x 2 C 2 \l-x-x 2 C 3 

Now Ck refers to the "correction term" for parts of the path occurring at height k. We 
can now easily find the generating function for many variations of the problems considered 
here. Here are several examples. 

Theorem 9. The generating function for Motzkin paths with no peaks (UD subpaths) is 



c 2 - x + 1 - Vx 4 - 2x 3 - x 2 - 2x + 1 
2x 2 



Proof. Set C = — 1 in (18) to correct for the empty path between the up and down steps 
and solve as before. □ 

Remark. This is sequence A4148 in the OEIS [5]. 
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Theorem 10. The generating function for Motzkin paths in which only plateaus at odd 
height have weight y is 

(1 -x)(A+ y/A(A + 4x 2 j) 
2x 2 A ' 

where A = (1 — x){x 2 {xy — x) + x — 1). 

Proof. Set C2fe+i — xy — x and C^h — in ( p2"| . At even height, no correction is necessary. 
In this case, if we call the generating function /(a;, y), we easily get 

f(x,y) = 1 ^ ; 

1 — x — x 2 (xy — x) 



1 — x — x 2 f(x, y) 

The proof is completed by solving for /. □ 

Remark. The corresponding triangle is surprisingly close — but not equal — to sequence 
A114581 in the OEIS. (They differ for paths of length 7.) 

Theorem 11. The generating function for Motzkin paths in which UHDs have weight y, 
UHHDs have weight z, and no plateaus of length three or more appear is 

(23) -04(2) + 1) + vPi+lpi+1) 



2x 2 {x- 1) 

where A(k) = x{x — l)(x 3 z + x 2 y + x + k). 



Proof. In (22), set Ck = xy — x + x z — x — x A /(I — x). To explain why, notice that the 
xy — x and x 2 z — x 2 terms give the correct weights to UHD and UHHDs, respectively, 
and subtracting x 3 / (1 — x) = a; 3 + x 4 + x 5 + ■ ■ ■ eliminates the possibility of plateaus of 



length three or more. Using the functional equation ( 18 ) one can find that the generating 



function is as in (23). □ 



Remark. Notice that, by setting y and z to 1 in (23), this is another way of counting the 
number of Motzkin paths with minimal plateau length 1 and maximal plateau length 2. 
(Compare with Prodinger and Wagner [3].) 

Theorem 12. The generating function which counts Motzkin paths in which UHDs at 
height 2 or more have weight y, and UHHDs at a height that is a multiple of 3 have 
weight z is given by 

G{x,y,z) = 

1 — x — x z p 

where 

_ a + Vb 

P ~ 2x 2 D ' 
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and 

A = x 2 Y(x 2 Y(x 2 Y + 3x - 3) + x 2 Z(x 2 Y + 2x - 2) + 2x 2 - 6x + 3) 

+ x 2 Z(2x 2 - 2x + 1) - 2x 2 + 3x - 1, 
fl = (x 2 r - l)(x 2 y + 2a; - 1)(£> - x 3 Y - x 3 Z - 2x 2 + x) 

(D + x 3 Z + x 3 Y - x), 
D = x 2 Y{x 2 Z + x 2 Y + x-2) + (y- z)x 4 + x 3 Z -2a5 + l, 
Y = xy — x, 

ry _ 2 2 

/j — x z x . 

Proof. It is easy to see what our correction terms must be: 



k 



12 3 45 6 78 9 10 
Y Y + Z Y Y Y + Z Y Y Y + Z Y 



Above, the correction term Y equals xy — x and Z equals x 2 z — x 2 . If G is the generating 
function for such paths, the continued fraction expansion for g is 

(24) G 1 1 * 2 1 * 2 1 ^ 1 



1-35 \l-x-x 2 Y I 1 -x-x 2 (Y + Z) \l-x-x 2 Y 



|l-a;-a; 2 y | 1 - x - x 2 (Y + Z) 

We need to split off the "purely periodic" part of that continued fraction; call that 
generating function p. It satisfies 

_ 1 | x 2 | x 2 | 

P ~ | 1 - x - x 2 Y ~ \ l-x- x 2 (Y + Z) ~ | 1 - x - x 2 Y - x 2 p 
and therefore equals 

a + Vb 

P ~ 2x 2 D ' 

with A, B, and D as in the statement of the theorem. The theorem now follows. □ 
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